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Abstract. In 1870s, L. Boltzmann proved the lamous ii-theorem for the 
Boltzmann equation in the kinetic theory of gas and gave the statistical in- 
terpretation of the thermodynamic entropy. In 2002, G. Perelman introduced 
the notion of VF-entropy and proved the W-entropy formula for the Ricci flow. 
, This plays a crucial role in the proof of the no local collapsing theorem and in 

the final resolution of the Poincare conjecture and Thurston's geometrization 
conjecture. In our previous paper [21], the author gave a probabilistic interpre- 
tation of the VF-entropy using the Boltzmann-Shannon-Nash entropy. In this 
paper, we make some further efforts for a better understanding of the mysteri- 
ous W^-entropy by comparing the if -theorem for the Boltzmann equation and 
the Perelman IF-entropy formula for the Ricci flow. We also suggest a way to 
construct the "density of states" measure for which the Boltzmann _ff-entropy 
is exactly the VF-entropy for the Ricci flow. 

^ ■ 1 Introduction 

in 



o 



In a seminal paper [31], Perelman introduced the VF-entropy for the Ricci flow and the 
associated conjugate heat equation and proved its monotonicity on compact manifolds. 
. More precisely, let M be an n-dimensional compact manifold with a family of Rieman- 

nian metrics {g(t) : t G [0,T]}, / G C°°(M x [0,T],R), where T > is fixed. Suppose that 
(g(t), f(t),r(t),t G [0, T]) is a solution to the evolution equations 



d t g = -2Ric, (1) 



S ; dtf = -Af + \Vf\ 2 -R+-^, (2) 

d t r = -1, (3) 

Following [31], the VF-entropy functional associated to (1) and (2) is defined by 

W(g, f, t) = [r(R + | V/| 2 ) + / - n] * )n/2 dv, (4) 

where v denotes the volume measure on (M,g(r)). By [31], the following entropy formula 
holds 



d 



df 



^-W(gJ,T) = 2l T mc+V 2 f-f ,/ -j^ dv. (5) 
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As a consequence of the Perelman VF-entropy formula (5), the W^-entropy is monotone 
increasing in r and the monotonicity is strict except that (M, g(r), /(r)) is a shrinking Ricci 
soliton, i.e., 

Ric + V 2 f = ^. (6) 

This result plays a crucial role in the proof of the no local collapsing theorem, which is 
equivalent to the long time standing Hamilton's Little Loop Conjecture [18]. As pointed 
out by Perelman [31], "this removes the major stumbling block in Hamilton's approach to 
geometrization" (for the resolution of the Poincare conjecture and Thurston's geometrization 
conjecture). See also [4, 12, 19, 25]. 

Since Perelman's paper [31] was posted on Arxiv in 2002, many people have established 
the VF-entropy formula for various geometric evolution equations [5, 21, 22, 28, 29, 16, 24, 20] . 
However, it seems that there is no reference in the literature which explains clearly how the 
mysterious Vl^-entropy was introduced for the Ricci flow and what are the hidden insights 
for Perelman to introduce the VK-entropy for the Ricci flow. In our previous paper [21], 
the author gave a probabilistic interpretation of the VF-entropy using the the Boltzmann- 
Shannon-Nash entropy. The purpose of this paper is try to make some further efforts for 
a better understanding of the mysterious M^-entropy by comparing the iJ-theorem for the 
Boltzmann equation and the Perelman VF-entropy formula for the Ricci flow. We also suggest 
a way to construct the "density of states" measure for which the Boltzmann iJ-entropy is 
exactly the H^-entropy for the Ricci flow. 



2 History and Boltzmann entropy formula 

2.1 Thermodynamic entropy 

The notion of entropy was introduced by R. Clausius in 1865 in his study of the Carnot 
cycle in the thermodynamics [13, 14]. He proved that, in any reversible thermodynamic 
process, ^ is an exact form, where SQ denotes the total change of the heat along the 
reversible thermodynamic process, and T is the temperature. This leads Clausius to define 
the thermodynamic entropy S as a state function of the thermodynamic system satisfying 

dS = 5 -$. 
T 

Thus, if the reversible thermodynamic process changes its states from A to B, then 

s(b)-s(a)= jy-^. 

Moreover, the value of S(B)—S(A) is independent of the choice of any reversible process from 
A to B. If the thermodynamic process is irreversible, the second law of thermodynamics says 
that: The thermodynamic entropy S of an isolated thermodynamic system always increases, 
i.e., 

AS > 0. 

In this sense, the thermodynamic entropy £ is an important quantity (as a function of the 
state) to characterize the irreversibility of the thermodynamic processes. 

2.2 Boltzmann equation and //-theorem 

In 1872, Boltzmann published an important paper [1], which contained two celebrated results 
nowadays known as the Boltzmann equation and the Boltzmann TJ-theorem. More precisely, 
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let f(x, v, t) be the probabilistic distribution of the ideal gas at time t in the phase space M 6 of 
position x and velocity v, then / satisfies the Boltzmann equation (see e.g. [f , 3, 1 7, 9, 8, 10]) 

dtf + v-V x f = Q{f,f) 

where 

Q(f,f)= I f [f(x,v')f(x,v:)-f(x,v)f(x,v*)]B(v-v*,6)dv*dS(u), 

JR3 J S 2 

where dS denotes the surface measure on S 2 , v', v' r are defined in terms of v, v*, u by 

v' = v - [(v - v») • u]u, v[ = u* + [(v - v») ■ u]u, 

and B : M? x S 2 — > (0, oo) is the collision kernel and is assumed to be rotationally invariant, 
i.e., B(z, u) = B(\z\, \z ■ u\), Vz e R 3 and u G 5" 2 . Let 

H(t)= [ f{x,v,t)logf(x,v,t)dxdv (7) 

JR 6 

be the Boltzmann iJ-functional of the probability distribution f(x,v,t)dxdv. The Boltz- 
mann H- Theorem states that, if f(x,v,t) is the solution of the Boltzmann equation, which 
is "sufficiently well-behaved" (in the sense of Villani [34], for its precise meaning, see [9]), 
then the following formula holds (see e.g. [1, 3, 17, 9, 8, 10]) 

^ = 7 / / (/'/: - //*)[log(//*) - log(ffi)]B(v - v*,6)dv*dS(u), (8) 
at 4 J S 2 J R3 

where / = f(-,v,-), f = f(-,v',-), /* = /(•,«*,•). /* = /(■,<,•)■ By the Boltzmann formula 
for the iJ-functional (8) and using the elementary inequality 

{x - y)(logy - logx) < 0, Vx,yeR+, 

one can conclude that H is always decreasing in time, i.e., 

^<0, Vt>0, (9) 
and the equality holds in (9) if and only if 

/'/: = //*, V^»eR 3 ,«S 2 , (10) 
which implies that / is a local Maxwell distribution, i.e., 

, s ( m \ 3 ^ 2 / \v — v(x, t)\ 2 \ , w , 

where the parameters m is the mass of particle, n(x, t) s M 3 is the particle density at (x, t), 
v(x,t) e M 3 and T(x,t) > are the mean velocity and the local temperature at (x,t). 

2.3 Boltzmann entropy formula 

In 1877, to better explain his i7-theorem, Boltzmann [2] introduced the statistical interpre- 
tation of the thermodynamic entropy S by the formula 

S = klogW, (12) 



3 



where k is a constant, which is nowadays called the Boltzmann constant (for simplicity, we 
choose k = 1 throughout this paper), and W is the German word "Wahrscheinlichkeit" of 
the English word "probability" , which is identified with the number of possible microstates 
corresponding to the macroscopic state of a given thermodynamic system, i.e., the number of 
(unobservable) "way" in the (observable) thermodynamic state of a system can be realized 
by assigning different positions and momenta to various molecules of the ideal gas. The 
Boltzmann entropy formula (12) indicates the logarithmic connection between Clausius' 
thermodynamic entropy S and the number W of the most probable microstates consistent 
with the given macrostate. 

We now explain the Boltzmann entropy formula (12) by studying the following question: 
Take N identical particles, which will be distributed over k boxes, and let pi, . . . ,pk be some 

k 

rational numbers in [0, 1] such that ^2 Pi = 1. We can regard pj as the probability for each 

t=l 

particle to be distributed into the j-th box. Let W be the number of configurations such 
that Nj particles are distributed in the j-th box, j = l,...,fc, and P the corresponding 
probability. Then 

N\ 

W = 



m\...N k \ 

and 



JVi!...iV fc ! 



Assuming that Nj » 1, j = 1, . . . , k. By the Stirling formula log iV! = (N + 1/2) logiV + 
N + \ log(27r) + 0(1/N), we have 

log P ~ (n + ±) log N - ]T Uj + ±\ log Nj - N i logft - k ~^~ log(2vr). 

Using the method of the Lagrangian multiplier, we can prove that the maximum value of P 

k 

subject to the constraint ^ Nj — N is achieved at Nj = pjN and we have 

i=i 

logP max ~ -1 log TV - (^Pi N + lo m - Iog(27r). 



i=i 
Therefore 

k 

nax ^ 1 

N^OO N 



logPmax oV^ 1 



i=l 



Let Wmax be the corresponding number of the configurations such that P achieves its max- 
imum value P max . Then (cf. also [34]) 

c ,. logVKmax , . 

S : " J lm m = -VpilogPi. (13) 

i=l 

By comparing the Boltzmann entropy formula (13) with the if-functional (7) introduced 
by Boltzmann in the study of the kinetic theory of gas, one can see that the iJ-functional 
is nothing else but the minus entropy of the probability distribution f(-,-,t) in the phase 
space at time t. 
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2.4 Shannon and Nash entropy 

In 1948, C. Shannon [32] introduced the notion of entropy into the theory of information. 
More precisely, 

k 

H = -^Klogft. 

According to Shannon [32] , "the form of H will be recognized as that of entropy as defined in 
certain formulations of statistical mechanics where pi is the probability of a system being in 
cell i of its phase space... H is then, for example, the iJ-in Boltzmanns famous fZ-theorem." 

On the other hand, J. Nash [26] used the i?-entropy to study the continuity of the 
parabolic and elliptic PDEs. In the literature, the Boltzmann .ff-entropy is sometime called 
the Shannon entropy or the Nash entropy. In this paper, we call H the Boltzmann-Shannon- 
Nash entropy, or for simplicity the Boltzmann entropy. 

2.5 The maximum entropy principle and the central limit theorem 

According to Boltzmann's entropy formula, the entropy S of a given macrostate achieves its 

k 

maximum value at the most probable microstates subject to the constraint Nj = N. 

i=i 

The following theorem, which can be proved by the method of Lagrangian multiplier, 
indicates a deep connection between the central limit theorem and the maximum entropy 
principle, in view of which, one can interpret the central limit theorem as a consequence of 
the maximum entropy principle. 

Theorem 2.1 Let V = {fi = fdx e P(M) : j M xdfj,{x) = 0, J M x 2 dp(x) = 1}. Then 

7 = argminjif (/i) : /i G D}. 

2.6 Canonical ensemble and Boltzmann's entropy formula 

Heuristically, the canonical ensemble is a measurable configuration space (SI, J 7 ) on which 
"there exist" a priori measure Dto and a Hamiltonian function E : SI — > [0, +oo] , such that 
the distribution of the particles on (f2, J 7 ) is given by a probability measure P on (SI, T) 
which has the following formal expression 

dP( w ) = —e-^^Doj, 

where 

Z P = f e-WMDu, 
Jn 

is called the partition function. In the literature, the probability measure P is called the 
Gibbs measure. We use (SI, J 7 , E,F) to denote the canonical ensemble (SI, J 7 ) with the 
Hamitonian function E and with the Gibbs measure P. In the kinetic theory of ideal gas, 
SI is the phase space of the positions and the velocities of the particles, and P is also called 
the Maxwell-Bolztmann distribution. 

To introduce the Maxwell-Boltzmann distribution, let us consider the following problem: 
Let us assume that TV particles of ideal gas are distributed into n rooms R\ , . . . , R n , each 
room Ri has gi boxes, i= 1, . . . , n. Suppose that if a particle is in the room R4, it has energy 
Ei, i = 1, . . . ,n. Then the total number of ways that these N particles are distributed in 
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to boxes of these n rooms, for which TVj particles are in the room Ri and with energy Ei, is 
given by 

lli=i JV *- i=1 

The most probable distribution is the one for which W achieves its maximum value under 
two constraint conditions: 

n n 
i=l i=l 

By the method of Lagrange multiplier, and using the Stirling asymptotic formula, one 
can prove that, in the case N » 1 and TVj >> 1, the most probable distribution satisfying 
the above two constraint conditions is given by 

N i = Ag i e- f,Ei ,, i = l,...,n. 

where A and j3 are two constants. By the theory of thermodynamic, it is known that j3 is 
related to the absolute temperature T via 

» = h- 

where k is a constant, called the Boltzmann constant. To determine A, it is useful to 
introduce the partition function 



-/3B, 

— / y 
i=l 

Then 



Hence, the most probable distribution, i.e., the Maxwell-Boltzmann distribution, is given 

by 

By Boltzmann's entropy formula (12) in Statistical Mechanics, the thermodynamic entropy 
of the macrostate system is given by 

S^fclogW. 

Using the explicit expression of the Maxwell-Boltzmann distribution, one can prove that 

S = kNlogZp + kpE. 

Let 

n _ 
i=l 

Then we obtain the Boltzmann statistical mechanics interpretation of the S'-entropy: 

log: W 

S= Jim -A- =108^ +/3(E). 

In the continuous case, let P be the Gibbs measure on a canonical ensemble (f2, JF) with 
Hamiltonian energy function E : ft — > R + . Then the Maxwell-Boltzmann distribution is 
given by the following probability measure on (R+,B( 

dP(E) = -— 9 {E)dE 1 

Aft 
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where j3 € R is the Boltzmann constant, g(E)dE denotes the "density of states" measure, 
whose physical meaning is the number of microstates with energy levels in the range [E, E + 
dE], and 



Zp= [ e-? E g(E)dE 



is the partition function. In this case, one can define the temperature of the macrostate 
system by 

T=I 

and define the Hclmholtz free energy by 

F = ~\ogZ . 

One can verify that, the average of the energy with respect to the Maxwell-Boltzmann 
distribution satisfies 

and the following formula holds for the Boltzmann entropy S of the Maxwell-Boltzmann 
distribution: 

S = \ogZ [i -p^\ogZ fj . 

Moreover, the fluctuation of the energy with respect to the Maxwell-Boltzmann distribution 
is given by 

a:=((E-(E)f) = ^logZ /3 , 

and the derivative of the entropy with respect to (3 satisfies 

f)G pp. 

By the definition formula /3 = i, we can verify the following formulas 



and 



(E) = T^logZp, F=-T\agZ p , 
S = ^(TlogZ,) = -§, 



dS__o_ 



3 Perelman's interpretation of the VF-entropy for Ricci 
flow 

In Section 5 in [31], Perelman gave a heuristic interpretation for the VF-entropy using sta- 
tistical mechanics. Let (M,g(r)) be a family of closed Riemannian manifolds, rfm(r) = 
g ( T ) a probability measure on (M,g(r)), where g(r) satisfies the Perel- 
man's backward Ricci flow equation -§^gij = Rij + V,Vj/, and /(r) satisfies the heat 
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equation d T f = A/— |V/| 2 + i?— Assume that for some canonical ensemble (O, T,E,F) 
on which there is a "density of state measure" g{E)dE such that the partition function 
Z = /r+ e-f iE g{E)dE is given by 



[ (-/+2) dm , (14) 



logZ= / (_/+_)dm, 

where /3 = i, and r is regarded as the temperature. Then, using the formulas in statistical 
mechanics, we can obtain 



(E) = =-r 2 / (i?+|V./f-f )dm, 

[ (T(R+\\7,f\ 2 )+,f-n)dm, 

[ IRij + ViVjf -^-gij\ 2 dm. 
Jm 2t 



IM 

a = 2t 4 

' M 



Alternatively, we can consider the evolution equations (1) and (2) by replacing the t- 
derivatives by minus of the r-derivatives, where r = T — t. This implies that 

W = -S, (15) 

and 

dm. (16) 



dw = r 

dt A 



r 

M 



It 



The above statistical mechanics interpretation (15) of the VF-entropy and the derivation 
of the derivative formula (16) are heuristic. The problem whether there is a canonical en- 
semble (O, J 7 , E, P), equivalently, whether there is a "density of states" measure g(E)dE, 
such that the partition function Z = J R+ e~ l3E g(E)dE satisfies Perelman's required con- 
dition log Z — J M (§ — f)dm remains open. It is a very interesting to know whether one 
can use some ideas of the quantum field theory to construct a "density of states" measure 
on some natural canonical ensemble such that the Boltzmann entropy of the corresponding 
Maxwell-Boltzmann distribution is exactly given by S — —W. See Section 5 below. 



4 A probabilistic interpretation of the VF-entropy for 
Ricci flow 

In [21], the author gave a probabilistic interpretation of Perelman's VF-entropy for the Ricci 
flow. We now present this interpretation. For this, observe that 



/ 

J A 



71 71 

(--f)dm=-(l + log(4nr))-H(m), 

M 1 1 



where 



f f Ti 6 ^ 

H(m) = - / ulogudv = / (/+ -l g(47rr))- — rrjndv 
Jm Jm 2 (47rr)"/ 2 

is the Boltzmann-Nash-Shannon entropy of the probability measure dm — udv, where u = 
,. e On the other hand, let 

IMI 2 

d7n(x) = -r^-j-.dx 
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be the Gaussian measure on K™. Then it is well-known that the Boltzmann-Nash-Shannon 
entropy of j n is given by 

77 

H{ln) = -(l + Iog(47rr)). 

Hence, log Z — H(j n ) — H(m) is the difference of the Boltzmann-Nash-Shannon entropy of 
the Gaussian measure 7„ on R" and the Boltzmann-Nash-Shannon entropy of the heat kernel 
measure dm — u{T)dv g ^ on (M, g(r)). In view of this, we have the following probabilistic 
interpretation of the W-entropy for the Ricci flow 

and 

^~ = 2T Im^ RiJ + ViVj/ ~ ~^ 9l ^ dm - 

Remark 4.1 During the preparation of this paper, Songzi Li pointed out to the author that 
the quantity F := — r log Z appeared in the definition formula of the W-entropy W — — §7 
is actually the Helmholtz free energy function on the canonical ensemble (O, F, E, P), where 
r = i is regarded as the temperature. According to Otto [27], if one chooses F(u) = 
J M u log udv + J M Vudv as the Helmholtz free energy of a certain thermodynamic system, 
where V € C 2 (M), then the gradient flow of F in the Wasserstein space equipped with 
a suitable infinite dimensional Riemannian metric is the Fokker-Planck equation dtu = 
Au + V • (uW). In view of this, the W-entropy for the Ricci flow can be regarded as 
the thermodynamic entropy corresponding to the Helmholtz free energy function F(u) = 
T(H(j n ) — H(u)), which is the difference of the free energy of a certain thermodynamic 
system on (M,g(r)) and the free energy of the Maxwell thermodynamic equilibrium state 
on K". This explanation is indeed equivalent to the above mentioned Perelman's heuristic 
interpretation, and is very close to the kinetic interpretation given by the author in [22] for 
the VF-entropy for the Fokker-Planck equation on complete Riemannian manifolds. 

5 Comparison between Boltzmann's i7-theorem and Perel- 
man's entropy formula 

In the above sections, we have discussed, following the idea of Perelman, the relationship 
between the Boltzmann TJ-entropy and the Perelman VK-entropy. In this section we would 
like to compare the Boltzmann 7?-theorem and the Perelman W-entropy formula. 

The Boltzmann //-entropy formula (8) and the Perelman W-entropy formula (5) are in 
the same spirit in the following three points. 

(i) The Boltzmann //-entropy formula (8) gives the time derivative formula of the Boltz- 
mann iJ-entropy along the solutions of the Boltzmann equation, and the Perelman W- 
entropy formula (5) gives the time derivative formula of the Perelman W-entropy along the 
solutions of the Ricci flow equation and the conjugate heat equation. 

(ii) From the Boltzmann //-entropy formula (8) and the Perelman W-entropy formula 
(5), we can easily derive the monotonicity of the Boltzmann iJ-entropy along the Boltzmann 
equation and the monotonicity of the Perelman W-entropy along the Ricci flow and the 
conjugate heat equation. 

(iii) We can derive the equation of the equilibrium state for the Boltzmann //-entropy and 
for the Perelman W-entropy. The equilibrium state of the Boltzmann //-entropy satisfies 
the equation (10), and the equilibrium state of the Perelman W-entropy is the shrinking 
Ricci solitons which satisfy the equation (6). 
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In the case of the Boltzmann equation, the problem of the convergence rate of the 
solutions of the Boltzmann equation towards the equilibrium state (i.e., the Maxwell dis- 
tribution) is the well-known Cercignani conjecture in the study of the Boltzmann equation. 
See [11, 6, 7, 15, 33]. From the above comparison, we can raise the following interesting 
problem for the further study of the Perelman's iy-entropy. 

Problem 5.1 What is the longtime behavior of the evolution equations (1) and (2)? If 
the solution (g(t),f(t)) of (1) and (2) exists on [0,oo), what is the convergence behavior of 
(g(t),f(t)) towards its limit as t — > oo? 

In [31], Perclman raised the following question 

Problem 5.2 If the flow is defined for all sufficiently large r (that is, we have an ancient 
solution to the Ricci flow, in Hamilton's terminology), we may be interested in the behavior 
of the entropy S as r — > oo. A natural question is whether we have a gradient shrinking 
soliton whenever S stays bounded. 



6 An open problem: the "density of states" measure 
for the Ricci flow 

Following Perelman's heuristic interpretation of the VF-entropy for the Ricci flow, we would 
like to discuss the following open problem. 

Problem 6.1 Can one prove the existence of a certain canonical ensemble (ft, J 7 ) with a 
priori measure Doj and a Hamiltonian function E : il — > R + such that the partition function 
of the corresponding Gibbs measure P on (SI, F) satisfies Perelman's condition 

log / e~^Du= [ (~f)dm? 
Jn Jm v 2 ' 

Equivalently, 

log / e-^Doj = H n (u,t), 

where 

H n (u,t) := -(1 + log(47rr)) - / ulogudv. 
2 Jm 

Moreover, if such a canonical ensemble (f2, J 7 , P) and a Hamiltonian function E : O — > R+ 
exist, how to construct them in a natural way? 

Suppose that such a canonical ensemble (fl, J 7 ) with a Hamiltonian function E : 51 — > K+ 
exist. Let P be the Gibbs measure on (ft, J 7 ). Let dP(E) be the image measure of the Gibbs 
measure P on (R+,S(M+)) under E : Vt ->■ M+, in other words, dP(E) is the probability 
law of the Hamiltonian energy function E considered as a random variable from (f2, J 7 , P) 
to (R+,B(M+)). Then one can write 

dP{E) = -—g(E)dE, 

Z P 

where dE is the Lebesgue measure on (R + , £>(R + )), and g(E)dE is the "density of states" 
measure of the canonical ensemble (ft, T, P) and the Hamiltonian E : ft — > M + . In view of 
this, the "density of states" measure g(E)dE must satisfy 
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log / e-P E g(E)dE = H n (u,t). 



(17) 



This is to say, the log-Laplace transformation of the "density of states" measure g(E)dE on 
(M + , £>(IR + )) equals to H n (u,t) = J M — /) dm. Formally, by analytic extension of the 
partition function (3 — > Z((3) := J R+ e~ l3E g(E)dE, and using the inverse Fourier transfor- 
mation, we have (cf. [30] p. 56) 



where = + i(3" s a complex variable with /?' > 0, and the path of integration is parallel 
to the right of the imaginary axis, i.e., along the straight line Re/3 = j3' > 0. Of course, 
the path may be continuously deformed so long as the integral converges. Thanks to this 
observation, it might be possible for us to prove the existence of the "density of states " 
measure g(E)dE on a natural canonical ensemble (f2,J-", P) and for a natural Hamitonian 
E : CI — > R + such that the partition function of the Maxwell-Boltzmann distribution on 
(CI, T, E,P) satisfies Perelman's condition (17), i.e., 
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